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^ Abstract. A definition of the nonadditive (nonextensive) conditional entropy 

O 

^ indexed by q is presented. Based on the composition law in terms of it, the Shannon- 

Ph 

Khinchin axioms are generalized and the uniqueness theorem is established for the Tsallis 
entropy. The nonadditive conditional entropy, when considered in the quantum context, is 

a -1 

• • 

always positive for separable states but takes negative values for entangled states, 

X 

indicating its utility for characterizing entanglement. A criterion deduced from it for 
separability of the density matrix is examined in detail by using a bipartite spin- 1/2 
system. It is found that the strongest criterion for separability obtained by Peres using an 
algebraic method is recovered in the present information-theoretic approach. 
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In this contribution, we report recent results [1] in developing a nonadditive 
generalization of quantum information theory based on the idea of Tsallis' entropy [2]. In 
the field of mathematical information theory, the entropy similar to Tsallis' has been 
known for a long time [3]. It seems, however, that it has not been fully developed due to 
the lack of the concept of the g -expectation value [4] discussed below. The introduction 
of the q -expectation value enables us to construct the important notion of the nonadditive 
conditional entropy. As we shall see, such a theory is, when generalized to include 
quantum theory, very useful in the context of quantum information. It is shown that this 
generalization leads to characterization of quantum entanglement and yields the 
separability criterion for the density matrix. 

First, let us recall the Boltzmann-Shannon entropy 

w 

s[p] = s(p v p 2 ,L ,p w ) = ~Y J pMp„ (l) 

1=1 

where {p,-}. =12L w is a normalized probability distribution and W is the number of 

microscopic states. This entropy is characterized by the Shannon- Khinchin axioms, 
which are given as follows [5]: 

[I] S(p v p 2 ,L , p w ) is continuous with respect to all its arguments 

and takes its maximum for the equiprobability distribution p t =l/W 
(/ = 1,2,L ,W), 

[II] S[A, B] = S[A] + S[B\A\ , 
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[Ill] S(p v p 2 ,L , p w ,6) = S(p v p 2 ,L ,p w ). 



In the second axiom, S [A, B] and S[A] are the entropies of the composite system (A, B) 
with the joint probability distribution p u (A, B) (i = 1, 2, L , W; j = 1, 2, L , W) and the 

subsystem A with the marginal probability distribution p i (A) = ^J i p ij (A, B), 
respectively. »S[5|A] is the conditional entropy associated with the conditional 
probability distribution p u (B\A) = p u (A, B)j p t (A) : 



W 

S[B\A] = (S[5|A,.]) (A) - £ p,(A) S[B\A], (2) 

where 5[5|A ( ] is the entropy of the conditional probability distribution. In the special 

case when A and B are statistically independent, then, 5[5|A] = S[B], and therefore the 
following law of additivity holds: 

S[A,B] = S[A] + S[B]. (3) 

The uniqueness theorem [5] tells us that a quantity satisfying the axioms [I]-[III] is 
unequivocally the Boltzmann-Shannon entropy in eq. (1), up to a constant multiplicative 
factor. We point out that there is a correspondence relation between the Bayes 
multiplication law and the axiom [II] : 
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Pij {A, B) = Pi (A) Pij {B\A) S[A, B] = S[A] + S[B\A]. (4) 

Now, we consider a nonadditive extension of the above structure based on the Tsallis 
entropy indexed by a positive parameter q 



s q [p] = s q {Pi> Pi> L >Pw) = JZ^ 



(5) 



This quantity converges to the Boltzmann-Shannon entropy S[p] in the limit <^ — > 1. It is 
positive and concave, and satisfies the H-theorem, just as S[p] . It also fulfills the axioms 
[I] and [III] for the Boltzmann-Shannon entropy. However, the additivity indicated in eq. 
(3) is violated, in general. To exhibit this feature, it is commonly stated in the literature of 
nonextensive statistical mechanics that the factorized joint probability distribution 
p u (A, B) = Pi (A) Pj(B) gives rise to pseudoadditivity 

SJA, B] = S q [A] + S q [B] + (1 - q)S q [A]S q [B]. (6) 

However, this discussion is unsatisfactory, because the assumption of the factorization of 
the joint probability distribution is not justified in nonextensive systems. For example, if 
the subsystems are interacting through a long-range force, their spatial separation does 
not make them independent, since the effect of the interaction persists at all distances. In 
fact, it turns out that the maximum entropy probability distribution obtained from the 
Tsallis entropy with constraints on physical quantities never factorizes [6]. On the other 
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hand, the Bayes multiplication law always holds in any situation. This consideration leads 
us to seek a definition of the nonadditive conditional entropy. 

A definition of the nonadditive conditional entropy we propose here is 



VY 

(A) EW A )] ( s «i B \M 

S q [B\A] = (S q [B\A i ]) s s±-r • (7) 

I [pM)Y 



i=l 



This is the g -expectation value [4] of the Tsallis entropy 5 9 [5|A ; ] of the conditional 

probability distribution and is a natural generalization of eq. (2). An advantage in this 
definition may be seen as follows. Using eq. (5), we can rewrite eq. (7) as 



r , , S a \A, B\- S a \A] 



Rearranging this equation, we find 

S q [A, B] = S q [A] + S q [B\A] + (1 - q)S q [A] S q [B\A]. (9) 

Therefore, we observe the correspondence relation 
Pij (A,B) = Pi (A)p u (B\A) 

O S q [A, B] = S q [A] + S q [B\A] + (1 - q)S q [A] S q [B\A], (10) 
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which is a natural nonadditive generalization of eq. (4). 

In a recent work [7], the following axioms were presented: 



[I]* S q (p v p 2 ,L , p w ) is continuous with respect to all its arguments 



and takes its maximum for the equiprobability distribution p i = 1/ W 



(i = l,2,L ,W), 



[II]* S q [A,B] = S q [A] + S q [B\A] + (l-q)S q [A]S q [B\A], 



[III]* S q (p v p 2 ,L ,p w ,6) = S q (p v p 2 ,L ,p w ). 



It was shown [7] that a quantity satisfying these axioms leads uniquely to the Tsallis 
entropy in eq. (5). 

Let us reconsider the above discussion in the quantum mechanical context. In 
quantum information theory, it is of central importance to understand the properties of 
quantum entanglement. We demonstrate that the nonadditive conditonal entropy will lead 
us to characterization of quantum entanglement in the information-theoretic language. 
The probability distribution is now replaced by the normalized density matrix p . The 
quantum counterpart of eq. (5) for the composite system (A, B) is 



where Tr stands for the trace operation over the composite system. This quantity 
converges to the celebrated von Neumann entropy in the limit q — > 1. To construct the 




(ID 
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nonadditive quantum conditional entropy, we substitute the Tsallis entropy of the 
marginal density matrix, p(A) = Tr B p(A, B) with Tr fi standing for the partial trace 

operation over the subsystem B , as well as eq. (1 1) into eq. (8): 



i + (i-,)s,[/KA)] ' <12) 



In the limit q — > 1, this quantity approaches the conditional von Neumann entropy, which 
has been discussed in Ref. [8] in the context of separability of the density matrix. 

It should be noted that though classically the nonadditive conditional entropy is 
always nonnegative, its quantum counterpart in eq. (12) can be negative. This can be 
easily seen if p(A, B) is taken to be a pure state. In this case, S 9 [p(A, 5)] vanishes, 

whereas S 9 [p(A)] is positive in general. Special is the case when p(A) is also a pure 

state and 5 ? [p(A)] vanishes. In a more general situation in which the state is mixed, 

S q [B\ A] vanishes for the product state p(A, B) = p(A) ® p(B). These facts show that the 

change of sign of the nonadditive quantum conditional entropy gives rise to a criterion of 
separability of quantum states. To be explicit, let us consider the classically correlated 
state, which is also referred to as the separable state in the literature. This state is defined 
by a convex combination of product states [9]: 

p(A,fi) = £ w x p x (A)®p x (B), (13) 
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where < w x < 1 and w x = 1 . It is known that this state can be modeled by using 

local hidden-variable theories and satisfies the Bell inequalities. To calculate the 
nonadditive quantum conditional entropy of this state, we employ the spectral resolutions 
of p A (A)and p x (B): 



pM) = L p»I«X«I. p.( 5 ) = L h{b)\b){b\, 



(14) 



where {\a}} and [\b)} are respectively the orthonormal eigenstates of the subsystems A 
and B, 0< p x (a),r x (b)<\, and ^ a Px( a ) = ^ b r \(b) = l- Then, the nonadditive 
quantum conditional entropy is calculated to be 



E 

a 


E 

. x 


w x p x (a) 
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(15) 



where 



(16) 



7r(&|a) = 



L W xPx( a ) r x( b ) 

L w xPx( a ) 



(17) 
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Clearly, < n{b\ a)<\ and 7l(b\ a) = 1, and therefore, S q [B\ a] is nonnegative. Thus, 

we see that the nonadditive quantum conditional entropy is nonnegative for any 
classically correlated state. 

Now, let us consider a simple bipartite spin- 1/2 system (i.e., a 2 x 2 system) to see if 
the nonadditive quantum conditional entropy can yield a criterion for separability of the 
density matrix. Our primary purpose is to clarify how the separability criterion can be 
strengthened by controlling the value of the parameter q . Consider a parametrized form 
of the Werner- Popescu state [9,10] 

p(A, B) = ^ I A ® I B + x |, (18) 

where < x < 1, I A (j B ^ the 2x2 identity matrix in the space of spin A (B), and |^~^ 
the singlet state given by 

\ r )=-z$)°\i).-\W).)- ™ 

After some algebra, the nonadditive quantum conditional entropy is found to be 
S q [B\A] = S q [A\B] = ^- 



l 2 J 2 



fl + 3x 



v 



(20) 
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This is a monotonically decreasing function of x for a fixed value of q . The minimum 
value of x at which S q [B\ A] changes its sign is 

x = ^, (21) 

which is reached in the limit g — > oo . This means that the Werner-Popescu state with 
x e [1/3, l] is not separable, that is, entangled. Local realism does not hold in this range 
of the parameter. It can be shown that the conditional von Neumann entropy, 
5 [5 1 A] := lim^j S q ^B\ A], changes its sign at x = 0.748. Also, it is known that the 

discussion of the Bell inequalities yields x = l/V2 = 0.707 . Therefore, we see that the 
nonadditive quantum conditional entropy leads to a criterion which is much stronger than 
those derived from the Bell inequalities and the conditional von Neumann entropy. 
Actually, the value in eq. (21) has been derived in Ref. [11] using the algebraic method of 
partial transposition of the density matrix and is known to be the strongest criterion [12]. 
Here, we have derived this criterion based entirely on the information-theoretic approach. 

In conclusion, we have presented a definition of the nonadditive (nonextensive) 
conditional entropy indexed by q . Based on the composition law in terms of it, we have 
generalized the Shannon-Khinchin axioms for the Tsallis entropy. Furthermore, we have 
discussed the nonadditive conditional entropy in the quantum context. We have derived 
the strongest criterion for separability of the density matrix of a bipartite spin- 1/2 (i.e., 
2x2) in the limit g— >°°. It is known [12] that the method of Ref. [11] gives the 
strongest criteria only for 2x2 and 2x3 systems. Therefore, it is of interest to examine 
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the present nonadditive quantum conditional entropy for 3x3 or other general systems. 
The work in this direction is in progress. 
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